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ABSTRACT 


This  thesis  is  an  independent  partial  evaluation  of  the 
Safety  Reliability  and  Maintainability  Program  (SR&M).  The 
two  Measures  of  effectiveness  which  were  used  to  see  if  the 
goals  of  this  program  were  realized  in  the  areas  of 
maintainability  and  reliability  are  the  Maintenance  Manhours 
per  Flight  Hour  and  the  Mean  Flight  Hours  Between  failures. 
Standard  statistical  analysis  was  performed  utilizing  the 
software  packages  GRAFSTAT  and  MINITAB. 
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I .  INTRODUCTION 

The  purpose  of  this  thesis  is  to  conduct  an  evaluation 

of  the  C-46  SR&M  (Safety  Reliability  and  Maintainability 
Program) . 

In  December  1980,  Boeing-Ver tol  was  awarded  the  initial 
contract  for  the  helicopter  improvement  program  known  as 
SR&M.  This  program  is  intended  to  extend  the  effective 
service  life  of  the  HH-46,  CH-46D  and  CH-46E  helicopters 
until  the  end  of  this  century  at  a  significantly  reduced 
operating  cost  . 

There  are  three  major  goals  for  the  SR&M  program: 

IMPROVED  SATETY  -  reduce  the  number  of  personnel 
injuries  and  deaths  that  result  from  the  malfunction 
of  aircraft  systems  and  its  components. 

IMPROVED  RELIABILITY  -  increase  the  mean  flight  hours 
between  failures  of  aircraft  components. 

IMPROVED  MAINTAINABILITY  -  reduce  the  maintenance  man 
hours  per  flight  hour. 

The  first  prototype  SR&M  modified  CH-46E  was  flown  in 
November,  1983.  The  first  delivery  to  the  Fleet  Marine 
Force  occurred  in  December,  1985.  Marine  Helicopter 
Training  Squadron  204  (HMT-204)  was  the  first  Fleet  Marine 
Force  squadron  to  receive  the  modified  aircraft. 

Today  there  are  over  fifty  modified  aricraft  in  service. 
Data  on  number  of  failures,  flight  hours  and  maintenance  of 


these  aircraft  has  been  accumulated  in  the  Navy's 
Maintenance  Material  Management  System  (3M).  This  data 
was  used  to  conduct  an  evaluation  of  the  SR&M  program.  The 
hoped  for  improvements  in  maintainability  and  reliability 
will  be  evaluated  using  the  data  accumulated  on  HMT-204's 
maintenance  department. 

This  squadron  was  selected  because  it  has  been  operating 
this  aircraft  the  longest.  It  also  appears  to  be  a  good 
candidate  since  it  has  consistent  and  regular  flight  hour 
requirements  each  month.  Unlike  deploying  fleet  squadrons 
that  gear-up  for  major  operation  and  experience  changing 
environments;  operating  from  Navy  ships  which  results  in  a 
higher  supply  priority  code,  HMT-204  does  not  deploy. 

A  brief  history  of  the  CH-46  aircraft  follows  to  emphasize 
how  past  modifications  were  made  to  improve  or  enhance  the 
operational  characteristics  of  the  aircraft  (i.e.,  airspeed, 
payload,  range  and  all  weather  capabilities,  etc.).  The 
stated  purpose  of  the  SR&M  modification  is  to  improve  the 
overall  safety  and  reliability  of  the  aircraft  and  its 
components.  This  should  result  in  reduction  of  the 
maintenance  cost  associated  with  operating  the  CH-46E  in 
the  Fleet  Marine  Force. 

The  SR&M  (Service  Reliability  and  Maintainability  Program) 
modified  CH-46E  Tandem-rotor  helicoptor  in  use  by  the  United 
States  Marine  Corps  has  come  a  long  way  in  its  30  year  history. 
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Boeing-Vertol  began  preliminary  design  and  engineering  of 
the  helicopter  in  1956.  Construction  of  the  first  prototype 
began  in  May,  1957.  The  first  flight  of  the  aircraft  took 
place  on  April  22,  1958.  The  United  States  Marine  Corps 
first  ordered  the  CH-46A  in  February  of  1961.  The  CH-46A 
was  powered  by  2  General  Electric  T58-GE-8  1250  shp  (shaft 
horse  power)  engines.  This  aircraft  had  a  maximum  take-off 
and  landing  weight  of  21,400  pounds  and  could  cover  a  230 
nautical  mile  range.  This  aircraft  had  little  or  no  single 
engine  capability.  You  could  not  maintain  level  flight  with 
a  single  engine.  The  Marine  Corps  would  eventually  receive 
over  130  of  this  aircraft  model. 

All  CH-46s  delivered  after  July,  1966  are  designated 
CH-46D.  The  CH-46D  is  essentially  similar  to  the  CH-46A 
except  the  aircraft  was  now  powered  by  2  General  Electric 
T58-GE-10  1400  shp  engines.  This  aircraft  had  a  maximum 
take-off  and  landing  weight  of  23,000  pounds  (1,600  pound 
increase)  and  could  cover  a  238  nautical  mile  range.  This 
aircraft  had  a  limited  single  engine  capability.  Aircraft 
could  operate  at  a  minimal  rate  of  descent  depending  on 
aircraft  load  and  outside  ambient  conditions,  if  one  of  the 
engines  stopped  operating.  Another  major  change  in  the  D 
model  production  was  the  addition  of  cambered  rotor  blades 
to  improve  the  aerodynamic  performance  of  the  rotor  system. 
By  June,  1969  the  Marine  Corps  had  received  its'  500th 


CH-46  aircraft. 


All  CH-46s  delivered  after  July,  1968  are  designated 
CH-46F.  The  same  engines  and  rotor  blades  used  in  the  D 
model  were  used  during  F  model  production.  The  addition  of 

improved  navigational  and  electronic  equipment  was  the 

i 

i 

reason  for  model  designator  modification.  The  maximum 

i 

take-off  weight  did  not;  change.  With  the  addition  of  275 
pounds  of  electrical  equipment,  the  available  payload  was 
decreased  accordingly,  j  All  D  model  CH-46s  in  the  inventory 
also  received  the  new  equipment.  This  resulted  in  major 

t 

differences  in  the  electrical  schematics  and  different 
operating  procedures  for  each  model  in  the  event  of  certain 

i 

electrical  malfunctions'.  The  production  of  CH-46Fs 
continued  until  1971  when  the  last  new  CH-46  rolled  off  the 
assembly  line.  All  future  improvements  and  modifications 
would  be  made  at  the  Naval  Air  Rework  Facility  ( NARF ) 

Cherry  Point,  North  Carolina. 

Boeing-Ver tol  modified  2  CH-46s  in  1975  with  2  General 
Electric  T58-GE-16  1870,  shp  engines.  This  model  also 
included;  crash  attenuating  seats  for  the  pilots,  a  new 
crash  and  combat  resistant  fuel  system,  an  improved  rescue 
system  and  an  updated  navigational  system.  The  Marine  Corps 
accepted  this  program  and  agreed  to  modify  276  CH-doD/F  to 
CH-46E  configured  aircraft.  During  August,  1977  the  first 


CH-46E  for  the  Fleet  Marnie  Force  rolled  out  of  the  Naval 


Air  Rework  Facility  (NARF)  Cherry  Point,  North  Carolina.  The 
aircraft  now  had  a  maximum  take-off  and  landing  weight  of 


23.300  for  internal  cargo  and  could  operate  at  a  weight  of 

24.300  with  an  external  load.  Internal  loads  are  limited 
to  23,300  pounds  due  to  the  load  bearing  limits  of  the  main 
landing  gear.  The  maximum  range  remained  at  238  nautical 
miles.  This  aircraft  has  outstanding  single  engine 
characteristics;  i.e.,  It  can  hover  in  ground  effect  at 
its  maximum  take-off  weight  under  all  but  extreme  ambient 
conditions.  During  this  conversion  the  Navy  and  Marine 
Corps  sponsored  substantial  testing  that  resulted  in  the 
acquisition  and  use  of  Fiberglass  rotor  blades.  By  1980 
there  were  70  CH-46E  configured  with  Fiberglass  rotor 
blades  As  a  point  of  interest,  with  the  significant 
reduction  in  maintenance  required  due  to  the  Fiberglass  rotor 
blades,  the  Second  Marine  Aircraft  Wing  (2nd  MAW)  played 
musical  chairs  with  the  Fiberglass  rotor  systems,  ensuring 
that  all  squadrons  deploying  out  of  th  continental  United 
States  left  with  the  new  rotor  system  installed  on  their 
helicopters.  It  took  unitl  1984  to  equip  all  the  CH-46s 

in  the  Marine  Corps  inventory  with  the  new  and  improved 
Fiberglass  rotor  system. 

In  December,  1980  3oe i n g -Ve r t o 1  was  awarded  the  initial 
contract  for  the  helicopter  improvement  program  known  as 
Service  Reliability  and  Maintainability  (SR&M). 


II.  DATA 


A.  DATA  COLLECTION 

Discussions  were  held  with  personnel  at  the  Navy  Sea 
Logistic  Center  Navy  Maintenance  Support  Office, 
Mechanicsburg  ,  Pennsylvania  to  determine  the  availability 
of  data  needed  to  perform  the  evaluation  analysis.  It  was 
decided  that  the  Navy's  Aviation  Maintenance  Material 
Management  System  (3M)  had  the  best  data  available.  The 
Navy's  3 M  data  has  wide  and  varied  purposes. 

-  DOCUMENTATION  -  The  3M  program  provides  records  which 
document  that  scheduled  and  unscheduled  maintenance 

is  performed  in  accordance  with  set  and  established 
procedures  . 

MANPOWER  ALLOCATION  -  Squadron  manning  levels  are 
determined  by  the  number  of  aircraft  and  mission 
requirements.  The  squadron  must  document  that  they 
are  working  technicians  the  prescribed  hours  per  day. 

SAFETY  -  All  Collateral  Duty  and  Quality  Assurance 
Inspectors  signatures  appear  on  the  VIDS/MAF  (Visual 
Information  Display  System /Maintenance  Action  Form) 
co  attest  to  the  fact  they  have  inspected  the  work 
and  witnessed  the  required  procedures  called  for  in  the 
Maintenance  Manuals. 

INFORMATION  -  Copies  of  all  VIDS/MAFs  generated  during 
the  last  ten  flights  and  all  "up"  gripes  are  maintained 
in  the  Aircraft  Discrepancy  Book  (ADB)  for  the  crew  co 
review  before  accepting  the  aircraft  for  flight 
operations  . 

-  SPECIAL  REPORTS  -  NAMSO  4 790 . A 7 298-0 1  is  one  type  of 
special  report  available  from  the  3M  system.  Table  I 
shows  a  typical  selection  of  the  data  used. 


1  2 


TABLE  I 

SAMPLE  FROM  NAMSO  4790.A7298 


The  3M  data  is  not  collected  to  be  used  for  strict 
statistical  analysis.  This  data  does  not  include  the  actual 
flight  hours  between  failures.  Consequently  some  analysis 
that  could  provide  specific  statistical  inferences  could 
not  be  made.  However,  some  interesting  comparative  results 
were  obtained  using  total  flight  hours,  total  failures  and 
total  maintenance  man-hours.  Mean  Flight  Hours  Between 
Failures  (MFHBF)  and  Maintenance  Man-Hours  per  Flight 
Hour  (MMH/FH). 

Observations  made  about  the  data  base: 

Although  the  data  was  not  collected  under  experimental 
conditions  and  has  some  shortcomings,  it  appears  from 
examination  of  the  data  that  both  data  samples  have 
the  same  inherent  set  of  shortcomings  relative  to  their 
impact  on  statistical  analysis. 

A  general  comparative  analysis  can  be  made  with  good 
credibility  that  assesses  whether  or  not  a  significant 
decrease  in  MMH/FH  was  achieved. 

Some  inferences  can  be  made  on  the  failure  rates  of  key 
components  as  a  function  of  the  number  of  repairs 
previously  made  on  the  component. 

Every  Maintenance  Action  Form  (MAF)  completed  by  HMT-204, 
to  document  maintenance  performed  by  squadron  personnel  on 
aircraft,  is  forwarded  to  the  Navy's  3M  system.  This  data 
was  then  tabulated  by  aircraft  bureau  number  (serial  number'1 
to  include  the  total  number  of  maintenance  actions  performed, 
actual  system/component  failure,  flight  hours  per  aircraft 
and  hours  of  maintenance  performed  (Table  I). 


A  VIDS/MAF  is  generated  in  three  ways: 

-  MAINTENANCE  CONTROL  PERSONNEL  will  issue  MAF's  to 
document  and  ensure  preventive  maintenance  is  completed 
according  to  flight  time  and  calendar  requirements. 

-  CREW  CHIEFS  or  PLANE  CAPTAINS  will  document  aircraft 
discrepancies  discovered  during  pre-flight  and  post 
flight  inspections. 

-  PILOTS  and  CO-PILOTS  will  document  aircraft  discrepancies 
discovered  during  pre-flight  and  post  flight  inspections. 
It  is  tne  pilot's  responsibility  to  complete  MAFs  covering 
ill  malfunctioning  aircraft  systems  and  inform 
Maintenance  Control  of  his  feelings  about  the  aircraft's 
operational  status  at  the  completion  of  all  flights. 

Modifications  to  aircraft  under  the  SR&M  program  were 

incorporated  luring  the  aircraft's  scheduled  Special  Depot 

Level  Maintenance  (5DLM)  cycle.  Aircraft  at  Marine  Corps 

Air  Station  (Helicopter),  New  River,  with  SDLM  dates  in 

1985  were  transferred  to  HMT-204.  This  accounts  for  the 

fact  that  HMT-204  was  assigned  19  different  aircraft  during 

the  time  pre-SR&M  data  was  collected.  The  11  in  the  post 

SR&M  sample  include  1  that  was  sent  back  to  NARF  Cherry 

Point  requiring  extensive  repair.  HMT-204  is  usually 

ill o  cate d  1 0  C H - 4 6  a  i  r  c  r  a  i  t  . 

At  the  time  the  data  was  requested  from  Mechanicsburg, 

the  last  month  entered  in  the  Navy's  Aviation  3M  System  was 

Mart:'  ".947.  1MT-204  received  its  last  SR&M  modified  aircraft 

luring  April  '°86.  This  means  May  1986  was  the  first  month 

the  jauadron's  :H  data  could  be  retrieved  by  Unit 

Identification  Code  (UIC).  Consequently,  11  months  was  the 

longest  period  of  time  post  SR&M  data  was  available  for  an 


operational  fleet  squadron.  HMT-204  received  its  first 
SR&M  modified  aircraft  during  December  1985.  In  order  to 
fceep  as  much  similarity  as  possible  between  the  two  data 
samples  it  was  requested  that  the  11  months  prior  to  first 
SR&M  delivery  be  used  for  the  pre-SR&M  data  base.  The 
periods  for  the  2  data  samples  are  as  follows:  January  1, 

1985  -  November  30,  1985  for  pre-SR&M  ( non-modif ied )  aircraft 
and  May  1,  1986  -  March  31,  1987  for  post  SR&M  (modified) 
aircraft . 

The  pre-SR&M  sample  contains  19  aircraft  logging  2688 
flight  hours.  The  post  SR&M  sample  contains  11  aircraft 
logging  2322  flight  hours  during  their  respective  periods. 

B.  DESCRIPTION  OF  DATA 

Following  is  a  description  of  th  data  (Table  I)  requested 
from  the  Navy's  Maintenance  Support  Office  in  Mechanicsburg  , 
Pennsylvania  . 

-  TOTAL  FLIGHT  HOUR  -  Flight  hours  reported  by  aircraft 
bureau  number  for  sample  period. 

-  TOTAL  MAINTENANCE  ACTIONS  -  The  number  of  unscheduled 
maintenance  actions  reported  in  VIDS/MAF  records. 

-  MEAN  FLIGHT  HOURS  BETWEEN  MAINTENANCE  ACTIONS  -  (MFHBMA) 
The  total  flight  hours  divided  by  the  number  of 
maintenance  actions  initiated. 

-  TOTAL  FAILURES  -  The  number  of  maintenance  actions  that 
were  confirmed  as  failures. 

-  MEAN  FLIGHT  HOURS  BETWEEN  FAILURES  -  (MFHBF)  The  total 
flight  hours  divided  by  the  total  number  of  failures. 


-  UN SCHEDULED  MAINTENANCE  MAN-HOURS  -  ( UMMH )  The  number 
of  man-hours  expended  in  the  performance  of  unscheduled 
maintenance  as  reported  in  VIDS/MAF  records. 

-  MAINTENANCE  MAN-HOURS  PER  FLIGHT  HOUR  -  (MMH/FH)  The 

.  total  unscheduled  maintenance  man-hours  divided  by  the 
total  flight  hour. 

-'MAINTENANCE  MAN-HOURS  PER  MAINTENANCE  ACTION  -  ( MMHMA ) 

1  The  total  unscheduled  maintenance  man-hours  divided  by 
the  number  of  maintenance  actions  initiated. 


III.  HYPOTHESIS  TESTING 


A.  HYPOTHESIS  DEVELOPMENT 

In  this  section  we  perform  one-sided  statistical  test  of 
hypothesis  about  the  difference  in  the  means  of  the  main¬ 
tenance  man-hours  per  flight  hour  (MMH/FH)  for  the  two  data 
samples,  i,e.  pre-SR&M  and  post  SR&M  components.  One  of 
the  stated  goals  of  the  SR&M  program  will  be  met  if  the 
maintenance  man-hours  per  flight  hour  (MMH/FH)  is  lower  for 
the  post  SR&M  aircraft  than  it  is  for  the  pre-SR&M  aircraft. 

Before  proceeding  to  hypothesis  testing  it  was  necessary 
to  establish  as  acceptable  distribution  for  MMH/FH.  This  was 
accomplished  using  standard  goodness  of  fit  tests.  After 
entering  numerous  samples  from  both  data  bases  into  the 
software  package  GRAFSTAT,  it  was  determined  that  the 
MMH/FH  data  could  be  Normalized  using  the  In  (natural 
logarithm,  base  e)  transformation.  Figure  3.1  (histogram  plot) 
and  Figure  3.1  (Quantile-Quantile  Plot)  from  GRAFSTAT  display 
the  transformed  data  1 n ( Y )  for  different  WUCs  fitted  to  the 
Normal  Distribution.  One  way  to  summarize  a  distribution  is  to 
partition  the  data  into  several  intervals  of  equal  length, 
count  the  number  of  points  in  each  interval,  and  plot  the 
points  as  bar  lengths  is  a  histogram.  [Ref.  2]  A  perfect 
Normal  distribution  is  superimposed  on  the  histogram.  Figure 
3.1  shows  the  Normal  distribution  to  provide  a  good  fit  to  the 


data.  In  a  Quantile-Quantile  plot  a  perfect  Normal  distri¬ 
bution  would  plot  as  a  straight  line.  [Ref.  2]  Again  the 
Normal  distribution  is  a  good  approximation  for  the 
distribution  of  the  data. 

The  Kolmogorov-Smirnof f  statistic  provided  by  GRAFSTAT 
was  0.049973  with  a  significance  level  of  0.8647.  The 
Chi-Square  value  was  2.1776  with  o  degrees  of  freedom  at  a 
significance  level  of  0.90267.  These  results  support  to  our 
assumption  that  the  ln(MMH/FH)  has  a  normal  probability 
distribution. 

Once  tne  data  was  transformed,  standard  hypothesis  testing 
procedures  (see  Gibra)  [Ref.  lj  were  used.  The  hypothesis  was 
designed  to  look  for  a  significant  difference  in  mean 
MMH/'FH  between  the  modified  and  non-modifred  aircraft. 
Specifically  a  one  sided  test  of  hypothesis  was  selected 
to  detect  if  the  mean  of  the  transformed  data  for  modified 
aircraft  is  substantially  smaller  than  the  mean  of  the 
transformed  data  for  non -modified  aircraft. 


There  are  two  ways  tne  typothesis  can  be  set  up: 


construct  1 

H  : 

0 

% 

> 

0 

H  ■  : 
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•ax 

■a  V 
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0 

tons  tract  2 

4  : 
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L  r  ~~ 

U. 
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ft  ~ 

JL 

'  y 

> 

0 

wnere  *  -  mean  of  a  natural  logarithm  of  the  maintenance 

man-hours  per  flight  lour  for  modified  aircraft 
(post  S R&M ) 

2'  a  =  mean  of  the  natural  logarithm  maintenance 

man-hours  for  non-modified  aircraft  (pre-SR&M) 


Rt'LAl 


If  the  hypothesis  is  set  up  as  described  in  construct 
2  the  null  hypothesis  (Hq  :  <_  0)  would  be  accepted 

(and  the  claim  of  improvement  "demonstrated")  if: 


s  « v, 

where  s  is  the  appropriate  estimate  of  the  standard 

deviation  of  X  -  Y,  ta v  is  the  upper  100(1  -  ®)  percentile 

♦ 

point  of  a  t -d is t r i b u t ipn  with  the  appropriate  degrees  of 
freedom,  r,  and  X  and  Y  are  the  sample  means  of  the  MMH/FH 
data  for  pre-SR&M  and  post  SR&M  respectively  for  the  hardware 
unit  under  consideration.  Note  that  t  and  s  are  both 

av, 

positive.  Consequently  we  could  accept  the  null  Hypothesis 
that  0  even  when  X  -  Y  is  positive  but  smaller 

than  s • t n  .  Consequently  little  or  no  actual  reduction  in 
MMH/FH  would  still  make  it  likely  that  we  would  accept  the 
null  Hypothesis  and  the  claim.  ,  This  construct  makes  it  easy 
to  "demonstrate"  an  improvement  without  having  effected  a 
substantial  improvement. 

However,  if  we  set  up  the  Hypothesis  as  described  in 
construct  1  with,  the  claim  for  improvement  in  the 
alternative  Hypothesis  ( H  :  n  -  m v  <  0)  it  is  much  more 
difficult  to  show  there  has  been  an  improvement.  In  this 
case  we  would  reject  Hq  (and  accept  the  claim  for  improvement) 
i  f  : 

T  -  T 

-  <  -t 

S  a  r, 
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This  means  not  only  must  (X  -  Y)  be  negative  it  must  be 


smaller  than  the  negative  number  s  t Q  If  we  can  say 

there  is  an  improvement  with  the  Hypothesis  set  up  this  way, 
there  is  a  greacer  chance  of  there  actually  being  an 
improvement  in  the  maintainability  Measure  of  Effectiveness 
( MOE  )  for  a  5 R&M  modified  CH-46 . 

The  raw  data  was  converted  into  CMS  (Conversational 
Monitor  System  in  use  at  N  .  X .  Church  Computer  Center)  files 
utilizing  the  software  package  GRAFSTAT.  Once  a  CMS  file 
with  the  data  vas  created  the  data  could  be  moved  into  the 
software  package  MINITAB.  and  tne  Hypothesis  testing  portion 
of  the  data  analysis  was  performed .  The  Hypothesis  used 


construct  1  H  :J  -A  >0 
o  x  y  — 

H  :  A  -  u  <o 
a  x  y 


The  rejection  rule  used  by  MINITAB  was: 


'(  -  Y 


(3.1) 


( (  S  ~  /  n  -+•  S  ~  /  m )  )  ~ 

X  V 


'■  3 “  ■  n  )  “  /  (  n -  1  )  i  +  [  (  3"  •  m) 


(m-1  )  ] 


(3.2) 


( S“ ) 


(3.3) 


where  , 


X 

Y 


a 


m 

■j 
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s 

s 


13 


sample  mean  for  post  SR&M  aircraft, 
sample  mean  for  pre-SR&M  aircraft, 
number  of  aircraft  is  the  post  SR&M  sample, 
number  of  aircraft  in  the  pre-SR&M  sample, 
level  of  significance, 

degrees  of  freedom  (see  equation  3.2), 
sample  variance  (see  equation  3.3), 
sample  variance  for  post  SR&M  aircraft, 
sample  variance  for  pre-SR&M  aircraft, 
the  square  root  of  S~ 


Recall  that  all  of  tne  above  statistics  are  formed  from  the 

natural  logarithm  of  the  MMH/FH.  The  100(1  -  ct  )  %  upper 

confidence  limit  for  ■■  -  u  is  X  -  Y  +  t 

x  y  a ,  o 

The  results  from  MIN IT A3  Hypothesis  testing  are  listed 
in  Tables  II  and  III.  These  tables  list  X  -  Y,  upper  80” 
and  90%  confidence  limits  and  in  the  last  column  the  largest 
confidence  level v for  wnic.n  the  upper  y%  confidence  limit  is 
zero.  If  the  upper  100  (L  -  a ) %  confidence  limit  is  less 
than  0,  the  the  Hvoothesis  H  :  J  -  -  >  0  would  be  rejected 
in  favor  of  H  :  -  -  u  •)  when  testing  the  hvpothesis  at 

Level  i.  It  is  usually  more  meaningful  to  the  user  to  think 
of  tne  v  values  in  the  iast  column  as  the  largest  confidence 
he  can  have  that  _  u  <  ;).  For  example  WUC  24A10  is  the 
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auxiliary  power  plant.  The  data  on  this  unit  shows  X  -  Y 

=  -0.349.  The  upper  80%  confidence  limit  for  y  -  y  is 

x  y 

-0.03.  That  is  we  are  80%  confident  that  y  -  y  <  -0.03. 

x  y  ' 

Similarly  we  are  90%  confident  that  y  -  y  <  0.14.  Also 

xv 

we  are  82%  confident  that  y  -  y  <  0.  It  is  interesting 

x  y 

to  note  that  there  are  8  items  of  the  21  listed  for  which  we 
are  less  than  50%  confident  that  any  improvement  in  mean 
maintenance  manhours  per  flight  huor  (MMH/FH)  has  been 

reduced  due  to  the  SR&M  program - using  this  data.  The  only 

difference  between  the  two  tables  is  Table  II  is  by  individual 
WUCand  Table  III  is  by  major  maintenance  category. 


TABLE  II 

RESULTS  OF  HYPOTHESIS  TESTING  BY  WUC 

UPPER  CONF  LIMIT  LARGEST 

ON  COM-  LEVEL 


table  III 


RESULTS  OF  HYPOTHESIS  TESTING  BY 
MAJOR  MAINTENANCE  CATEGORIES 


LPPER  COM-  LIMI- 
OX 


LARGEST 
CON F  LEVEL 


IV.  REGRESSION  ANALYSIS 


A.  PROCEDURES 

A  regression  analysis  was  performed  to  determine  if  the 
MFHBF  was  decreasing  as  a.  function  of  the  previous  number 
of  failures.  The  oalred  data  MFHBF  and  number  of  failures 
was  entered  into  an  APL  (a  mathematical  programming  language) 
workspace  by  work  unit  code  (VUG).  An  APL  program  was 
developed  to  compute  the  nean  flignt  hours  for  all  aircraft 
by  the  number  of  failures.  The  results  were  then  brought 
into  a  workspace  in  the  statistical  package  GRAFSTAT.  The 
paired  data  was  plotted  with  the  mean  flight  hours  between 
failures  (MFHBF)  on  the  y-axis  and  the  number  of  failures 
on  the  x-axis.  The  data  for  WUC  24A10  the  Auxiliary  Power 
Plant  ( A P P )  will  be  used  and  displayed  in  Figure  4.1 
(pre-SR&M)  and  Figure  4.2  (post  SRAM).  The  data  for  Major 
lain  tana nee  Category  l  3000  the  Landing  Gear  will  be  used  and 
displayed  in  Figure  4.3  (pre-SR&M)  and  Figure  4.4  (post  SRAM) 

The  Least  Squares  Estimates  of  the  slope  (b)  and  the 
Intercast  a'  were  then  computed  ) GRAFSTAT. 

.< 

The  Sum  of  Squares  G  i  ~  is  defined  is: 


MFHBF 


024A1 0 


Figure  4.1  PRE-SR&M  V/UC  -  4  A  l  0 
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N24A1Q 


=  154.56  +  -17.508  x 


5 


NUMBER  CF  FAILURES 


J  POST-SRAM  WUC  L  4  A  1 0 


MFilBF 


.  | ' m  *  a.t 


•j  u  *j»  w  l*  iii  ri* 


XN13CGQ 


Y  =  132.31  -r  — 13.335  x  X 


NUMBER  CF  -MURES 


•  :  ’’ire  *  . ->  .’O.ST-.'r  R.'F!  >-'.C  1  '00i) 


\v%vY'Y‘* 


u/v\>v»uvLs>-;:- 


(4.1) 


1  d  =  E  [ y  -(a  +  bx  )  ]  . 

i= 1  1  i  =  l  1 

When  the  left-hand  side  is  minimized  the  values  of  a  (inter¬ 
cept)  and  b  (slope)  describe  the  line  v  =  ax  +  b  that  best 
fits  the  data  using  the  method  known  as  least  squares 
regression.  This  was  done  to  estimate  the  time  until  first 
failure  (intercept)  and  the  rate  of  decline  in  MFHBF  (slope) 
per  failure  by  work  unit  code  for  numerous  WUC. 

Table  IV  displays  the  computed  values  for  the  slope  and 
intercept  associated  with  the  regression  of  MFHBF  on  number 
of  failures  for  selected  WUC  units.  They  were  computed  by 
GRAFSTAT.  Table  V  displays  the  same  information  for  major 
maintenance  categories.  For  example  13000  is  the  data  for  ail 
WUC  starting  with  the  numbers  13 - ,  the  CH-46  airframe. 

There  are  numbers  in  the  table  that  are  unrealistic, 
some  WUC  have  increasing  slopes,  i.e.,  the  part  is  less  likely 
to  require  maintenance  the  more  the  aircraft  is  flown.  These 
points  are  included  to  emphasize  the  problems  with  the  data 
base,  it  is  not  perfect  but  the  problems  should  be  the  same 
for  both  samples. 

The  data  in  Tables  I"r  ind  V  shows  that  the  aircraft  is 
likely  to  fly  more  hours  before  the  new  components  experience 
their  first  failure.  The  numbers  for  WUC  24A10  n on-modified 
aircraft  are  intercept  100.69  and  slope  -10.567,  and  intercept 
154.56  and  slope  -17.508  for  modified  aircraft.  The  numbers 


TABLE  IV 


LEAST  SQUARES  REGRESSION  FIT  BY  WUC 


INTERCEPT  SLOPE 


WUC 

OLD 

NEW 

% CHANGE 

OLD 

NEW 

11220 

169 

251 

148 

- 55.8 

-50.2 

11310 

15S 

257 

162 

-34.4 

-54.33 

11350 

102 

124 

180 

-10.3 

-  8.76 

11560 

123 

180 

-15.0 

-36.5 

11610 

84 

243 

290 

-  6.1 

-34.2 

11620 

- 

- 

- 

- 

- 

12510 

- 

- 

- 

- 

- 

13110 

138 

116 

-  5.7 

-61.2 

13210 

167 

194 

116 

-40.5 

54.8 

14130 

56 

211 

377 

-  2.7 

-35.9 

142  A0 

166 

rs 

107 

-36.3 

-14.3 

14210 

138 

223 

163 

-27.0 

26. S 

14230 

168 

25~’ 

153 

-49.8 

- 

14260 

147 

202 

137 

-19.1 

-32.8 

14270 

154 

296 

192 

63.8 

-68 

142S0 

167 

204 

122 

-33.6 

-35.9 

24AI0 

101 

154 

151 

-10.6 

-17.5 

26110 

- 

- 

- 

- 

- 

26120 

178 

241 

136 

-29.9 

-60.2 

26240 

150 

244 

163 

-r.  5 

-61.5 

26460 

142 

246 

1  ~4 

-46.8 

-13.0 

26510 

132 

190 

143 

-17.8 

-34.6 

26610 

133 

168 

127 

-20.8 

-21.8 

441 14 

86 

226 

262 

-  8.3 

45.5 

-  not  enough  data  for  one  of  the  samples  to  conduct  I. SR  comparison. 
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for  WUCs  starting  with  13 - (Table  V)  non-modif ied  aircraft 

are  intercept  100.11  and  slope  -11.842,  modified  intercept 
132.31  and  slope  -13.335.  Hypothetically  the  modified  air¬ 


craft  can  log  approximately  54  more  flight  hours,  on  average 
before  requiring  maintenance  on  its  APP.  This  is  an  improve 
ment  of  153%  for  the  APP.  In  the  case  of  VUG  starting  with 

13 the  improvement  was  132%.  This  fact  alone  should 

reduce  the  cost  of  operating  the  aircraft  in  the  Fleet 
Marine  Force. 

TABLE  V 

LEAST  SQUARES  REGRESSION  FIT  BY  MAJOR 
MAINTENANCE  CATEGORIES 


INTERCEPT 

SLOPE 

wcc 

OLD 

NEW 

■‘o  CHANGE 

OLD 

NEW 

1  1000 

1 1 

30 

l  S  2 

-0.15 

-0.36 

13' inO 

39 

5<> 

144 

-  3.1 

-  2.7 

!  }ooi) 

loo 

133 

133 

-11. S 

-13.3 

;  jooo 

50 

'1 

13" 

-  4.3 

-  4.4 

1  S’  >•  iM 

1  ! 

-v-> 

3oo 

-  0.3 

-  0.4 

3m  H  io 

\  _ 

"a 

-a.4 

-3.7 

-  3'  'i  >'  i 

-0 

D 

5  5 

-  i.9 

-  0.5 

<■*  improvements  :  a  neon  r  i  me  i  n  t  i  1  fir  a  r.  failure  range 
: r  > m  i  low  j :  .  ,7 "  to  j  a l g n  of  3 ' ' % .  It  is  interesting  to 

pom  .  i  n  numerms  c  me:;  tne  mean  time  until  first  tailor 

was  greatly  improved  while  the  slope  was  also  a  decreasing 


negative  number  so  after  4  or  5  failures  the  MFHBF  was 
essentially  equal  for  both  modified  and  non-modified  aircraft 
When  the  data  was  looked  at  grouped  by  major  maintenance 
categories : 

11000  Airframe 

12000  Fuselage  Compartment 

12000  Landing  Gear  System 

l-i 000  Flignt  Controls 

15000  Rotor  System 

26000  Drive  system 

j- 2 000  Electrical  Power  Supply 

The  improvements  varied  from  a  low  of  5  5  T  to  a  high  of  200C , 
in  the  mean  time  until  first  predicted  failure. 

The  WUC  analysed  were  selected  because  they  were  directly 
impacted  b v  one  of  the  S R & M  modifications.  Mr.  William 
Jennings,  the  Boeing-Vertol  Technical  Representative  at 
Marine  Corps  Air  Station  ( H )  Hew  River,  North  Carolina,  was 
v  e  r  •••  he  Inful  with  this  selection  of  WUC  . 

3.  DECREASING  TREND  AND  VARIANCE  ANALYSIS 

Tine  i  a  t  a  in  Table  IV  and  the  regression  charts,  suggest 
that  I F  rt  B  r  is  iecr  easing  is  the  number  if  fa  i  lures  increases, 
i  .  a  .  ,  -terns  with  a  failures  have  Lower  flight  hours  between 
fa:  lure  s  t  n  an  aircraft  with  1  or  1  failures?  If  til  is  is 
actual:;/  the  case  at  would  be  important  to  know  the  rate  of 
decrease  more  accurately  tnan  can  be  determined  from  this 


data  base.  It  is  necessary  to  have  the  actual  flight  times 
betweeen  each  failure  in  order  to  make  this  assessment. 

If  MFHBF  does  decrease  as  number  of  failures  accumulate, 
then  the  affect  of  the  S R & M  program  washes  out  after  some 
number  of  failures.  It  is  also  important  to  know  this  in 
order  to  more  accurately  estimate  the  reliability  of  each 
aircraft,  i.e.,  the  failure  history  of  its  components  affect 
its  reliability,  Here  it  would  be  good  to  have  the  actual 
flight  time  between  each  failure.  We  have  no  information 
to  confirm  or  deny  that  each  failure  was  a  separate  and 
distinct  problem. 

It  is  also  of  interest  to  know  if  the  variance  of  MFHBF 
changed  as  a  function  of  the  number  of  accumulated  failures. 
That  is,  is  s~  for  an  item  with  4  failures  the  same  as  for 
an  item  with  6  failures?  To  answer  this  question  three 
items  were  examined. 

In  Table  VI  the  number  of  failures  is  listed  in  the  far 
left-hand  column,  the  3  selected  VUC  across  the  too  and  the 
associated  variance  for  that  number  of  failures  is  listed 
where  appropriate.  If  there  was  no  aircraft  with  the  number 
of  failures  for  that  WUC  the  table  was  left  blank.  There  is 
a  wide  range  in  the  variance  for  ill  the  components  looked  i 
Just  by  looking  at  these  three  components  we  are  confident  i 
saying  the  variance  is  not  equal  among  groups  with  different 
number  of  failures. 


TABLE  VI 


VARIANCE  OF  FAILURE  RATE 

FAILURES  13110  24A10 


OLD 

NEW 

OLD 

NEW 

OLD 

NEW 

0 

1292.7 

2142.7 

3894.3 

0.0 

0.0 

1885.1 

1 

2908.9 

0.0 

722.0 

42S0.3 

1022.7 

3042.0 

2 

780.0 

242.0 

0.0 

0.0 

3 

125.0 

89.8 

214.2 

4 

12.5 

359.1 

1.3 

5 

0.0 

0.0 

6 

257.6 

0.0 

S 

0.0 

0.0 

84.6 
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V.  ADDITIONAL  ANALYSIS 


A.  REGRESSION  ANALYSIS  OF  MTSF  (MEAN  TIME  3ETVEEN  FAILURES) 

The  analysis  in  Chapter  IV  indicated  that  mean  flight  hour 
per  failure  decreased  as  the  number  of  failures  f  hence  repairs 
accrued  against  hardware.  If  this  relat  Lonshio  is  correct  it 
has  important  imnlications  for  scheduling  of  maintenance  — 
both  in  f  Light  hours  between  repairs  and  in  planning  resource 
ten ui remen ts .  The  CM  lata  used  to  make  cne  analysis  in 
Chapter  17  does  not  provide  sufficient  detail  to  make  an 
accurate  anal'-’ sis  of  the  linear  relationship  between  mean 
fiighc  hour  between  failure  and  number  of  accured  failures. 

The  data  needed  to  provide  an  accurate  analysis  is  the 
actual  flight  hours  between  each  failure  for  each  type  of 
component  (by  Iv’UC  or  serial  number)  for  which  such  analysis 
is  desired.  In  particular  if  sucn  an  analysis  is  desired 
to  oe  ieveioiaeu  ind  maintained  for  the  Auxiliary  3  o  w  e  r  Plant 
1  \  P  P )  units,  then  the  actual  flight  hours  between  each  failure 
at  each  AFP  unit  must  be  kept  by  A P P  serial  number. 

~".i  i  J  iata  would  mat  an  L  y  afford  trend  lines  but  would 
i.-io  xermit  toe  preuiction  of  percentile  points  far  the 
c ist reaction  of  flight  time  to  failure  for  \?P  units  which 
have  had  previous  failures  (and  repairs).  That  is,  this  type 
or  data  will  allow  us  to  make  an  estimate  of  number  of  flight 
hours,  t(a,i),  for  which 


P[Ti<  t (a 1i )  ]  =  a 

where  T  denotes  the  flight  hours  to  failure  of  an  APP  unit 

w n i c h  '.as  had  i  previous  failures.  For  example,  if 
i  =  0 . AO ,  APP  units  with  5  previous  failures  will  fail  again 
before  t '  a , i )  with  probability  0.90. 

3 .  GENERAL  A MALTS  [5 

The  following  analysis  can  be  applied  to  any  type  of 
assembly  i.e.,  APP .  Flight  Controls,  etc.  But  the  type  of 
assembly  is  fined  in  an  v  soecific  application.  The  i  a t  a 
always  refers  to  flight  hours  to  failure  for  the  same  type  i  f 
a  s  s  e  m  b  1  y  . 

The  model  we  use  makes  assumptions  about  the  orobabiltv 
distribution.  Specifically  we  assume  the  normal  distribution 
This  assumption  can  be  checked  by  appropriate  analysis  pro  v  id 
time  between  failure  data  is  available,  but  whatever  the 
appropriate  probability  distribution  is  determined  to  be.  a 
j  ini  lar  ina  i  vs  is  ten  oe  ieveiooed.  lost  >  f  the  analysis,  i.e 
the  regression  point  estimates  will  still  be  valid  regardless 
>  f  tiie  under  Iving  list:  i  but  ion  .  The  confidence  bounds. 

owever.  won  Id  :hnnge.  \  iso  .  if  enough  lata  is  available 
to  tnu.t  :  L  ;e  >r  more  tlignt  a  our  data  no  in  ts  ire  available 
for  earn  of  the  number  if  failure  points  (  i  .  e  .  ,  1  =  1.1.2,... 

then  the  normality  assumption  might  still  be  valid  because  we 


r 

Let  f  =  (  l  i)/F. 
1=0 


We  used  the  standard  regression  model,  T . .  =  1  -  bi  t  e . . . 

U  i  J 

i 

Where  e.  .  is  a  random  variable  with  mean  0  and  variance  “ 
ij 

for  all  ij.  Then 


E ( T .  . )  =  a  -  bi  . 
-  ] 


Then  at  each  failure,  i  =  0,1,2,..  .  , F  we  have  several 


observations  as  indicated  in  Figure  5.1. 


We  fit  a  regression  line  to  this  set  )  f  lata  using 


standard  least  su.ua res  methods.  The  least  squares  estimates 


a  and  b  for  a  and  b  respectively  are: 
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b 


=  (  I(T.  -  T ) i )  /  (  -  (i-f )Z) 

1  i  =  0 


Thus  the  data  points  ( T ^  ,  0  )  .  .  .  (  T  ^  ^,0),  ( T  ^  ^  ,  1 )  .  .  . 

(T.  , 2).,.(Tp  1,F)...(T&F,n.,F)  yield  the  fitted  line 

T  =  a  f  hi  in  Figure  5.1. 

To  obtain  the  t  (  ct,  i )  values  we  need  the  probability 

distribution  for  T. .  We  shall  assume  it  is  normal  with 

r 


mean  a  +  bi  and  variance  t ' 


,  th 


Then  the  a  percentile  point 

t  i"I 

t ( a , i )  is  a  -  bi  +  a  Z  a  where  Z  a  is  the  a  ‘  percentile  point 

9 

of  the  standardized  normal  distribution  (u  =  0,  a-  =  1). 

The  estimate  of  t  ( )  is 


t('-t.i)  =  a  +  bi  +  s(Z  ) 


2  2 
where  s  is  the  unbiased  estimate  of  o  . 

F  n  i  _ 

Z  =  U  -  T,)2 

_  i =o  1=1  ‘ 


( n . -1 ) 

l 


C.  IFF 2 FENCES  ON  SYSTEM  RELIABILITY 

The  appropriate  equation  for  helicopter  system  reliability 
R  ^  is  a  function  of  the  assembly  reliabilities;  i.e., 

R  =  g ( R R ,  )  where  R.  =  reliability  of  assembly  i.  In 


particular  if  the  assemblies  are  chosen  at  high  enough  level 
and  if  failure  times  are  statistically  independent, 


K 


The  appropriate  reliability  block  1  tag  ram  veil  depend  on  the 

level  u'  indenture  or  the  issenib  lies.  This  t.i  turn  v  ill 

t  e  t  e  r  m  i  ii  e  :  h  e  i  n  n  r  o  »  r  tat  a  ;  u  n  cr.  ton  ;  \  R  . . .1 .  )  . 

1  .< 

At  a  p  «aint  in  time  any  aircraft  will  be  compose -l  >  f 

issem  oltes  with  different  ‘a  i  lure  and  repair  recons.  "he 

>  o  i  .1 1  e  s  t  :aa  n  es  >  f  mission  re  liab  l  1  i 1  v  of  issemo  1  y  k  w  ill 

be  i  :  a n c  t  i  o  n  )  r  i ,  ~  ) .  i  •:  k  .  where  i  v  k  ;  is  the  number  jf 

previous  failures  >n  assemblv  k  of  that  particular  helicopter. 
1  ? 

"he  estimate  i~ ,  for  ~~ .  ind  the  Assembly  mission  time 

t ,  corresponding  to  s  v stem  ( h e 1 i c o o  t e r  )  time  t  will  v i e 1 d 
.< 

a  point  estimate  R .  f  t ,  )  if  R ,  (  t ,  )  the  mission  reliability  of 

rC  .<  .< 

the  k  component.  These  point  estimates  of  the  assembly 
mission  reliability  corresponding  to  system  mission  time  t 
••ill  ;  i  '  e  i  ioin  t  estimate  >  f  s  vs  tern  reliability:  namely. 


R  ,  >  t 

'  n 

1  R  ,  (  c  ,  ; 

.R.icw 

s 

L  j. 

r  *i  e 

'  j~  •  a  ■ 

m  .1  :i  a  r  y 

ilia  1  as  i 

a  i  i  u  r  •-?  s 

•)  r  o  v 

idea  in 

Cha  n  t:  e 

i  <  “  h  e  '] 

u  m  h  e  r 

o  f  f  a  i 

lares  i 

have  to 

level 

o  f  f  a  t 

some  p 

lifetime 

even 

with  repairs 

.<  <c 


cate  a  strong  decline 
This  will  certainlv 


44 


preliminary  results  suggest  that  keeping  the  additional 
data  needed  to  perform  the  analysis  cited  in  this  section 
could  well  beworth  the  effort. 
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VI.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  CONCLUSIONS 

The  data  in  Table  IV  indicate  the  items  for  which  we  are 
confident  that  there  is  an  improvement  in  the  reliability  of 
the  C-i6  5R&M  modified  aircraft.  At  present  there  is  not 
enougn  operatonai  data  available  to  verify  the  extent  of 
this  improvement.  Is  the  improvement  due  to  operating  with 
new  components'’  ’V ill  the  reduction  in  MFH3F  for  the  modified 
aircraft  result  in  more  maintenance  than  presently  indicated 
in  the  long  run’  These  questions  can  only  be  answered  with 
additional  data  analysis  in  the  future  when  more  complete 
data  becomes  available. 

Of  the  Twenty -  one  W  U  C  s  considered,  we  can  say  nine  of  them 
showed  a  reduction  in  the  MMH/FH.  Five  show  an  increase  in 
the  M M  HF  H .  The  other  seven  show  no  significant  change.  Thi 
leads  us  to  conclude  the  S  R  .1 M  modified  aircraft  has  some 
improved  maintainability.  We  may  also  see  greater 
improvements  when  mechanics  become  more  familiar  with  the 
n e w  s y stems /components  . 


3.  RECOMMENDATIONS 

Initiate  a  data  collection  program  to  collect  flight  hour 
between  failure  and  flight  hours  between  maintenance  action 
peformed  on  each  aircraft.  Perform  additional  analysis 
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